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psj 1 Introduction 

Q , The theory of agreement or consensus problems for multi-agent 
systems has emerged as a challenging new area of research in re- 
cent years. It is a basic yet fundamental problem in decentralized 
control of networks of dynamic agents and has attracted great 
^ , attention of researchers. This is partly due to its broad applica- 
lO '. tions in cooperative control of unmanned air vehicles, formation 
^ . control of mobile robots, control of communication networks, de- 
^ sign of sensor networks, flocking of social insects, swarm-based 
^ computing, etc. 



In jl], Vicsek et al. proposed a simple but interesting discrete- 
time model of n agents all moving in the plane. Each agent's mo- 
tion is updated using a local rule based on its own state and the 
! states of its neighbors. The Vicsek model can be viewed as a spe- 
■ cial case of a computer model mimicking animal aggregation pro- 
posed in [2] for the computer animation industry. By using graph 
theory and nonnegative matrix theory, Jadbabaie et al. provided 
a theoretical explanation of the consensus behavior of the Vicsek 
model in where each agent's set of neighbors changes with 
time as system evolves. The typical continuous-time model was 
proposed by Olfati-Saber and Murray in [4], where the concepts of 
solvability of agreement problems and agreement protocols were 
first introduced. In [4j, Olfati-Saber and Murray used a directed 
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graph to model the communication topology among agents and 
studied three agreement problems. They are directed networks 
with fixed topology, directed networks with switching topology, 
and undirected networks with communication time-delays and 
fixed topology. And it was assumed that the directed topology 
is balanced and strongly connected. In [|5j, Ren and Beard ex- 
tended the results of |3j and |4| and presented more relaxable 
conditions for state agreement under dynamically changing di- 
rected interaction topology. In the past two years, agreement 
problems of multi-agent systems have been developing fast and 
several research topics have been addressed, such as agreement 
over random networks PJT] , asynchronous information consensus 
jBI, dynamic consensus [2], networks with nonlinear agreement 
protocols [lLOJ, consensus filters IH], and networks with commu- 
nication time-delays p!2lJT3lfT4] . For details, see the survey [15] 
and references therein. 

By long-time observation of animal aggregations, such as schools 
of fish, fiocks of birds, groups of bees, and swarms of social bac- 
teria, it is believed that simple, local motion coordination rules 
at the individual level can result in remarkable and complex in- 
telligent behavior at the group level. We call those local motion 
coordination rules protocols. In the study of agreement problems, 
they are called agreement protocols. 

In the analysis of agreement problems, convergence rate is an 
important performance index of the proposed agreement pro- 
tocol. In [4j, a linear agreement protocol was given and it was 
shown that the second smallest eigenvalue of interaction graph 
Laplacian, called algebraic connectivity of graph, quantifies the 
speed of convergence of consensus algorithms. In |[TB], Kim and 
Mesbahi considered the problem of finding the best vertex posi- 
tional configuration so that the second smallest eigenvalue of the 
corresponding graph Laplacian is maximized, where the weight 
for an edge between two vertices is a function of the distance 
between the corresponding two agents. In |[T7j, Xiao and Boyd 



considered and solved the problem of the weight design by using 
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semi-definite convex programming, so that algebraic connectiv- 
ity is increased. If the communication topology is a small-world 
networks, it was shown that large algebraic connectivity can be 
obtained jTB] . Although by maximizing the second smallest eigen- 
value of topology graph Laplacian, we can get better convergence 
rate of the linear protocol proposed in jlj, the state agreement 
can never occur in a finite time. Therefore, finite-time agreement 
is more appealing and there are a number of settings where finite- 
time convergence is a desirable property. Our goal in this paper is 
to address finite-time agreement problems and present two dis- 
tributed protocols that can solve agreement problems in finite 
time. The method used in this paper is partly motivated by the 
work of [12], in which continuous finite-time differential equa- 



tions were introduced as fast accurate controllers for dynamical 
systems. 

This paper is organized as follows. In Section II, we state the con- 
sidered problem. In Section III, we give our main results. Simula- 
tion results are given in Section IV. Finally, concluding remarks 
are stated in Section V. 



2 Problem Formulation 



The distributed dynamic system studied in this paper consists of 
n autonomous agents, e.g. particles or robots, labeled 1 through 
n. All these agents share a common state space R. We use Xi to 
denote the state of agent i and suppose that agent i is with the 
following dynamics 

X,{t)=U,{t), lein, (1) 

where Ui{t), i G X„, seen as a whole, is the protocol to be designed, 
and = {1, 2, . . . , n}. 

In this multi-agent system, each agent can communicate with 
some other agents which are defined as its neighbors. We use 
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a weighted undirected graph Q{A) = {V,S,A) to represent the 
communication topology, where A = [aij] is a n x n nonnegative 
symmetric matrix, V = {vi : i E T^] is the vertex set, and 
E is the edge set. Vertex Vi corresponds to agent i. An edge of 
Q{A) is denoted by {vi^ vj), which is an unordered pair of vertices. 
{vi, Vj) G if and only if aij > 0, if and only if agents i and j can 
communicate with each other, i.e., they are adjacent. Moreover, 
we assume that an = for all i E T^. We call A the weight 
matrix and a^j is the weight of edge {vi^Vj). In consistence with 
the definition of agents' neighbors, the set of neighbors of vertex 
Vi is denoted by A^^ = {vj : {vi^vj) G S}. A path in a graph 
from Vi to Vj is a sequence of distinct vertices starting with vi 
and ending with Vj such that consecutive vertices are adjacent. 
A graph is connected if there is a path between any two vertices 
of the graph. More comprehensive discussions about graph can 
be found in 1201 • 



Protocol Ui is a state feedback, which is designed based on the 
state information received by agent i from its neighbors. 

Given protocol w^, i G we say that Ui or this multi-agent 
system solves an agreement problem if for any given initial states 
and any j, k G Xn, ~ Xk{t) \ ^ 0, as t ^ oo, and we say that 

it solves a finite-time agreement problem if for any initial states, 
there exist a time t* and a real number k such that Xj{t) = k 
for t > t* and for all j G X„. If the final agreement state is the 
average of the initial states, i.e., Xj{t) ^k=i^k{Q) ^^^^ j ^ Xn 
as t ^ (X), we say that it solves the average-agreement problem. 

With the above preparation, we present two agreement protocols 
that solve agreement problems in finite time: 

i) 
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ii) 

Ut= CLij sign(a;j- - x^)\xj - x^l", i G In, (3) 
where < a < 1 and sign(-) is the sign function, such that 

1, r > 
sign(^rj = <; 0, r = 0, 
-1, r < 

Remark: If we set a = 1 in the above protocols (12]) and (Ej), then 
they will become the typical linear agreement protocol studied in 
[Ij] and [l5j , and solve the average-agreement problem asymptoti- 
cally provided that Q{A) is connected. If we set a = in ([2]) and 
([2j), they will become noncontinuous. Research of them is beyond 
the scope of our study. In the next section, we will show that pro- 
tocols ([2]) and (Ej) all solve the finite-time agreement problems if 
G{A) is connected and < a < 1. 

Remark: The information exchange among agents is assumed to 
be bidirectional and thus the communication topology can be 
represented by an undirect graph. The study of the case with 
unidirectional information exchange will be a future research di- 
rection. 



3 Main Results 



We assume in this note that Q{A) is connected, since if Q{A) 
is not connected, then there exist at least two groups of agents, 
between which there does not exist information exchange, and 
therefore it is impossible for the system to solve an agreement 
problem through distributed protocols. 

Let 1 = [1, 1, . . . , 1]^ G W and let x = [xi, X2, . . . , Xn]^. We first 
show that the equilibrium point set of the considered differential 
equations Xi = Ui^i E Tji, is the set of all agreement states. 
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Property 1 With protocol (ED or (Ej); the equilibrium point set 
of the differential equations Xi = Ui^i G is span(l). 

Proof: We only consider protocol (El). 

Let ?/2, . . . , satisfy the equations = 0, ^ G and let 

Hk = min^ei^ y^. From Uk = 0,we have that i/t = yk,v^ e Nk- Let 
A^(i) = {k} U A^fc- By the same arguments, yi = Vi G A^^-^^ U 
U^^eTVd) Nj. Let iV(2) ^ ^(i) y u^^^^^^ iV^., and if is defined, 

let iV(*+i) = iV(*) U U„^.e7V(») ^j- By induction, we have yj = yk 
for all Vj G N^^\i = 1,2,.... Since G{A) is connected, there 
exists some i, such that A^*^*^ = {vi,V2, ■ ■ ■ ,Vn}- And therefore 
2/ = [2/1,2/2, • • • ,2/n]^ e span(l). 

We hope that all the equilibrium points are stable and state of 
the system reaches span (1) in finite time. 

Apparently, protocol (ED and (ED are continuous with respect to 
state variables xi, 0:2, . . . , Xn- Therefore, if we adopt one of these 
two protocols, then for any initial state a:(0), by Peano's Existence 
Theorem and Extension Theorem [21] , there exists at least one so- 
lution of differential equation ([ID on [0, 00). Moreover, one notices 
that (ED and (ED are not Lipschitz at some points. As all solutions 
reach subspace span(l) in finite time, there is nonuniqueness of 
solutions in backwards time. This, of course, violates the unique- 
ness condition for solutions of Lipschitz differential equations. 

In order to establish our main results, we need the following Lem- 
mas. 

Lemma 1 Let ?/2, . . . , 2/^ > and let p > 0. Then there exists 
m{n,p) > 0, which is a function of n and p, such that 
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Proof: Obviously 



i^l i=l 



Let y = [yi, 2/2, ... , ynf and let U = {y : y^ = 1 and y> 0}. 

If ELi y^ ^ 0, 

E^^i _ I Hi 

n 

p 



Let m{n,p) = infy(zu E^Li 2/f . Since E^Li vf is continuous and t/ is 
a bounded closed set, m{n^p) exists and m{n^p) > 0. And thus 
the inequality holds. 

m{n,p) can be calculated directly. Precisely, 

m{n,p) = min{n^~^, 1}. 

Lemma 2 |^ Let L{A) = [kj] G M"-^'^ denote the graph Lapla- 
cian ofQ{A), which is defined by 

k] — { 

j^i 

L{A) has the following properties: 

i) is an eigenvalue of L{A) and 1 is the associated eigenvector; 

a) x^L{A)x = \ Y.^ j^ittij^Xj — Xif' , and the semi-positive defi- 
niteness of L{A) implies that all eigenvalues of L{A) are real and 
not less than zero; 

Hi) IfQ{A) is connected, the second smallest eigenvalue of L{A), 
which is denoted by X2{La) and called the algebraic connectivity 
ofQ{A), is larger than zero; 
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iv) The algebraic connectivity ofQ{A) is equal to min^-^o,i^a;=o 
and therefore, if Ix^ = 0, we have that 

X L{A)x > \2{La) 



Now, we present our first main result. 

Theorem 1 // communication topology Q{A) is connected, then 
system (H]) solves an agreement problem in finite time when de- 
centralized protocol (ED is applied. 

Proof: Take semi-positive definite function 

Vi{x{t)) = - E a,j{xj{t) - x,{t))^ 

wtiicti will be proven to be a valid Lyapunov function for agree- 
ment analysis. 

Since Q{A) is connected, Vi{x) = implies that for any i,j G Tn, 
OC 2 00 n • And since A is symmetric, we have that 



dViix 



dxi 



— E ^iji^j ^ 



and 



dVi{t) _ ^ dVijx) . 

Xi 



dt 



i^i dxi 



= -E 



= -E 

i=l 



l+a 



n 



2\ 2 
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By Lemma [TJ we have 



dVi{t) 
dt 



< —m(n. 



1 + 



In 



2\ — 



where m(n, 
If (2:) 7^0, 



x'L{AyL{A)x 
\x^L{A)x 



Let the eigenvalues of L{A) be Ai(Lyi), A2(La), • • • , in the 

increasing order. Since Q{A) is connected, by Lemma [2], \\{La) = 
0,A2(L^) >0. 



Let 



D = 







A2(La) 



Since ^^(^4) is symmetric, there exists an orthogonal matrix T £ 
^nxn ^^^Yi that 



L{A) = T' DT. 



Therefore, 



x' L{Ay L{A)x _ 2x'T' DTT' DTx 
lxTL{A)x x^TTDTx 
_ 2x^TTD^Tx 
~ x^T^DTx 
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And we have that 



dVijt) 
dt 



< 



l+g 
2 



^l(^) 



-Vi{t) 



1+ct 



< - {2X2{La))— Vi{t)- 



Let Ki = {2X2{La))^ and let h = (^v^iW)^^^ . Given initial 
State x(0), if ^1(0) 7^ 0, 

2 

and 

limyi(t) = 0. 

Therefore, Vi{t) will reach in finite time ti, i.e., all states of 
agents will reach a consensus in finite time, and thus system ([T]) 
solves a finite-time agreement problem. 

The finite time is an upper bound of time which guarantee that 
all agents' states reach a consensus. Nevertheless, we can use it to 
establish a connect between convergence time and parameters: a 
and initial state. Since < a < 1, < < \ and | < < 1. 
If the initial value Vi(0) increases, then ti increases accordingly. 
This is obvious, since Vi(0) can be seen as the total potential 
energy among agents [22] and thus it will take much time to 
reduce it to zero. 

In [1], it was shown that if o; = 1, protocol (ED solves an agree- 
ment problem asymptotically and the convergence in such sys- 
tem is exponential with infinite settling time. If a = 0, the 
whole system becomes a non-smooth system. In this case, we 
can prove that the states of agents reach an agreement in finite 
time a::,(o)-niin, a:;,(o) ^ which is independent of graph weights. All 

those properties are reflected in our model, that is, 

lim ti = (X), 

a— >1 
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and 



lim ti = 



2Vi{0) 



Let P = ^l^x(O) and let x(0) = y+pi. Since l^x(O) = l^y + n(5, 
we have that = 0. 



2Vi(0) 



\ A2(L^) \ X2{La) 



xT{0)L{A)x{0) 



y^L{A)y 

>\iy^y> ^ 



> 



V2 

maxj Xi(0) — mini 3:^(0) 



Next, we consider protocol (El). 

Theorem 2 Consider system ([I]) wzt/i communication topology 
Q{A) that is connected. Given protocol ([3]), system ([T]) solves the 
average- agreement problem in finite time. 

Proof: Since aij = aji for all i^j G we get that 

n 
i=l 

Let 

]^ n 

K = - Y. Xi{t), 

and we have that k is time-invariant. Let Xi{t) = k + Si{t). Con- 
sequently, Y.i^iSi{t) = and 6i{t) = We take Lyapunov 
function 

where b = [(5i, ^2, . . . , ^n]^- In ^ is referred to as the group 
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disagreement vector. Differentiate V2{t) witfi respect to t 
dV2{t) " • 

+ ttj^dj sign{6i - 6j)\6i - 
= 9 E CL^J{6^ - 6j) sign((5_j- - 6^)\6j - S^l"" 
1 " 

1 n 2 , , 

= -7; i:(«,r(*.-*)')^'. 



By Lemma [11 

wfiere m{n^, = 1. 

2 

Let = E"j=i flj^/" (^i — Since communication topology 

Q{A) is connected, we fiave tfiat G{6) = if and only if ^ G 
span(l). Since Etl^^{t) = 0, G{6) = if and only if ¥2(5) = 0. 
Let U = {6 : V2{6) = 1 and 1^6 = 0}. Then t/ is a bounded 
closed set. Let 

K' = miG(6). 
Since Gib) is continuous, K' exists and K' > 0. 

We can calculate K' by matrix theory. 

2 

Let 5 = [6ij]nxn, where bij = a--^". Then 

n 

G{S) = E - Sjf = 26^L{B)6, 
where L{B) is the graph Laplacian of Q{B). 
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Since 1^(5 = 0, we have G{5) > 2\2{Lb)S^5, where \2{Lb) > is 
the second smallest eigenvalue of L{B). Since V2{5) = \5^5 = 1, 

And thus K' = 4X2{Lb). Therefore, if ¥2(1) 7^ 0, 



m(t) < _i (m^^^^^ 



1+a 
2 



dt - 2 \V2{t) 

< -l{4X2{LB)V2{t))'^ 



Let K2 = 2"A2(Lij)H^ and t2 = ^^""^^(o)^^ ^^^^ 

il-a)\2{LB) — 



1+a 
2 



dt 

And with the same arguments as in the proof of Theorem [T], we 
have that V2{t) reaches zero in finite time ^2, and system ([ID solves 
the finite-time average- agreement problem. 

We can see that the convergence time is closely related to the 
second smallest eigenvalue of L{B), that is, the algebraic con- 
nectivity of G{B). Maximizing it, we can get smaller convergence 
time. 



Besides that protocol ([3]) solves the average-agreement problem, 
another main difference between the two protocols is that the 
Lyapunov function V2{6{t)) used in the proof of Theorem E] does 
not depend on the network topology. This property of V2{6{t)) 
makes it a possible candidate as a common Lyapunov function 
for convergence analysis of the system with switching topology. 

Suppose that a^j is a piece-wise constant right continuous func- 
tion of time, denoted by aij{t), and takes value in a finite set, 
such that aij{t) = aji{t) > and aii{t) = for all z,j G And 
therefore the topology is changing as time evolves, denoted by 
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Theorem 3 // Q{A{t)) is connected all the time, then protocol 
solves the finite-time average- agreement problem. 



Proof: Since all aij{t),i,j G take value in a finite set, 

A = min Xoit) 

exists and A > 0, where X^iS) is the second smallest eigenvalue of 

2 

the graph Laplacian of ^(K^/" (^)])- 

Also let b[t) = x{t)-Kl and V2{6{t)) = \5'^{t)5{t). Then we have 
1^5{t) = and 

^ < -2-\'^V,{ty-^. 

Hi L 



1 y N 1— Q 

Therefore, V2{t) will reach zero in finite time ^3 = 



and the switching system solves the finite-time average- agreement 
problem. 

Remark: The conditions in Theorem E] can be relaxed in several 
ways. For example, we can assume that the sum of time intervals, 
in which Q{A{t)) is connected, is larger than ^3. 




(c) (d) 
Fig. 1. Four graphs:(a) Gi, (b) Q2, (c) ^3, (d) Q4 



4 Simulations 



In this section, we present some numerical simulations to illus- 
trate our theoretical results. 
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Fig. 2. State trajectories of agents with communication topology Gi and protocol 
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Fig. 3. State trajectories of agents with communication topology Gi and protocol 

(ED 
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Fig. 4. State trajectories of agents with switching communication topology 
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These simulations are performed with six agents. Fig. [T] shows 
four graphs and the weight of each edge is 2. For the multi- agent 
system with fixed topology, we assume that a = 0.5, the commu- 
nication topology is Qi, and initial state x(0) = [—5, —3, 7, 9, 4, 5]^. 
By calculation, Vi(0) = 338, ti = 11.7681. The trajectories of 
agents' states with protocol (E]) are shown in Fig. [21 If we ap- 
ply protocol ([31), we obtain that the average of initial states is 
2.8333, V2(0) = 78.4167, algebraic connectivity of the correspond- 
ing graph Q{B) is 1.0409, and thus t2 = 8.1673. The trajectories 
of agents' states are shown in Fig. [21 If the communication topol- 
ogy is switching from ^i, to ^2, to ^3, to ^4, and back to ^1, 
periodically, and each of them lasts for 0.25 seconds, then we 
apply protocol ([21) and the states of agents achieve the average- 
agreement in finite-time ^3 = 11.3000. The trajectories of them 
are shown in Fig. [H 



5 Conclusion 



We have considered the finite-time agreement problems of multi- 
agent systems with bidirectional information exchange. Two con- 
tinuous finite-time agreement protocols have been presented. Fur- 
thermore, the relations between upper bound of convergence time 
of each protocol and some parameters are also analyzed. 

The work of this paper is the first step toward finite-time consen- 
sus analysis of multi- agent systems, and there are still some other 
interesting and important topics need to be addressed. For exam- 
ple, do our protocols still work when the information exchange 
among agents is unidirectional? If the system is with switching 
topology and communication time-delays, do there exist similar 
results? And do there exist other effective finite-time protocols? 
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